A Markov Decision Process Approach with Embedded Stochastic Programming

The main objective of electric power dispatch is to provide electricity to the customers at low cost and high reliability. Transmission line failures constitute a great threat to the electric power system security. We use a Markov decision process (MDP) approach to model the sequential dispatch decision making process where demand level and transmission line availability change from hour to hour. The action space is defined by the electricity network constraints. Risk of the power system is the loss of transmission lines, which could cause involuntary load shedding or cascading failures. The objective of the model is to minimize the expected long-term discounted cost (including generation, load shedding, and cascading failure costs). Policy iteration can be used to solve this model. At the policy improvement step, a stochastic mixed integer linear program is solved to obtain the optimal action. We use a PJM network example to demonstrate the effectiveness of our approach. DOI: 10.4018/978-1-4666-0933-4.ch018